Papers with Disney World test
CAPE: Context-Aware Personality Evaluation Framework for Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies use a context-free approach to assess humans . existing studies use the Disney World test, which ignores real-world applications . |
| Approach: | They propose a framework to assess personality traits in large language models . they use conversational history to quantify the consistency of LLM responses . |
| Outcome: | The proposed framework improves consistency of responses in large language models . it also shows that conversational history enhances consistency and personality shifts . |